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(54) Method for decoding data received trom a data source using hardware configuration data 
received from the same data source 



(57) Today the storage of audiovisual (AV) data on 
storage media employs standardized coding schemes, 
e.g. MPEG-2. End user devices for AV presentation, like 
disc players, contain dedicated decoders implemented 
in hardware, which are able to decode data streams 
complying with the respective standard. The efficiency 
of this decoding methodology relies on the standardiza- 
tion of appropriate coding schemes. Proprietary coding 
schemes may be more efficient by being adapted to the 
content, or may be used for content protection or option- 
al features. Using reconfigurable decoder hardware, 
storing the configuration data for the actual decoder on 
the same storage medium as the AV data, and down- 
loading the data to configure the player can be used to 
implement proprietary coding schemes. Such schemes 
require appropriate player hardware, suitable to execute 
a downloaded decoder under real-time conditions, and 
a standardized format to store the decoder configuration 
data. 
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Description 

Field of the invention 

[0001 ] This invention relates to a method for decoding 
data read from a data source, e.g. a storage medium, 
wherein reconfigurable hardware is used. 

Background 

[0002] Hardware architectures dedicated to a special 
purpose may be implemented as reconfigurable devic- 
es, or otherwise as non-reconfigurable devices such as 
Application Specific Integrated Circuits (ASICs). Recon- 
figurable devices are commonly defined as devices 
whose computing architecture is defined after manufac- 
turing, andean usually be redefined. Examples are Field 
Programmable Gate Arrays (FPGAs), which provide full 
flexibility in terms of hardware (HW). However, various 
kinds of reconfigurable architectures differing from typ- 
ical FPGAs but fulfilling the general definition have been 
developed or are under development. Though less effi- 
cient than ASICs, such reconfigurable architectures al- 
low the implementation of arbitrary logic functions. 
[0003] Moreover, also general-purpose hardware 
may have functions that are adoptable by programma- 
ble parameters, e.g. a digital filter may be implemented 
whose coefficients are programmable, or software 
(SW), whether interpreted or compiled programming 
languages or assembly code, may be executed on gen- 
eral-purpose microprocessor or digital signal processor 
architectures. These examples are considered as soft- 
ware reconfiguration. 

[0004] However, recently proposed video coding 
schemes indicate that today's general-purpose archi- 
tectures and Digital Signal Processors (DSPs) do not 
offer the performance required for real-time decoding, 
especially when it comes to high-definition video. Fur- 
thermore they are expensive and power consuming. 
[0005] Further it is known that storage of audiovisual 
(AV) data on storage media, using e.g. Digital Versatile 
Disc (DVD) or hard disk in a Digital Video Recorder 
(DVR), relies on the standardization of the employed 
coding scheme, e.g. MPEG-2 or MPEG-4. Hence, end 
user devices, like e.g. disc players, employ dedicated 
decoders that are usually Implemented as hardware 
within ASICs. The decoders are able to decode data 
streams that are compliant with the respective standard- 
ized format, and usually give no or little possibilities for 
variation of the decoding. Therefore, such storage me- 
dia and the decoding devices heavily rely on the stand- 
ardization of appropriate coding schemes that can pro- 
vide the required efficiency. 

Summary of the Invention 

[0006] The problem to be solved by the invention is to 
provide more flexible devices for decoding AV data, and 



thus allow usage of arbitrary encoding schemes. 
[0007] According to the invention, a data source that 
provides AV content may also provide HW and SW con- 
figuration data representing the actual decoder that is 

s suitable to decode the AV content. The data source may 
be a storage medium, e.g. optical disc, or a broadcast 
receiver. The decoder configuration data may be read 
e.g. as a preamble to the AV content, and can be down- 
loaded to the player's HW at execution time, or shortly 

10 before execution time. Therefore the player may also 
contain means to store these data for later usage, e.g. 
flash memory. Further, the configuration data may also 
be encoded, and may require standard decoding before 
being utilized. 

15 [0008] The target hardware to execute the decoder 
function is a reconfigurable architecture. Typically, the 
downloadable decoder consists of a combination of soft- 
ware and hardware definition data. The format of the de- 
coder configuration data may be standardized to enable 

20 cooperation of media and player manufacturers. 

[0009] Advantageously, with the inventive method it 
is possible to implement proprietary decoders, and use 
proprietary coding schemes for encoding the AV data. 
These proprietary coding schemes have many advan- 

25 tages, such as e.g. high efficiency by adaptation to AV 
content, know-how protection of coding methodology or 
content protection by conditional access. Reproduction 
of such proprietarily coded AV data requires appropriate 
hardware, suitable to execute a downloaded decoder 

30 under real-time conditions. 

[0010] Compared to general-purpose architectures, 
reconfigurable architectures can offer a more flexible 
layer for specification of downloadable decoders. Some 
reconfigurable architectures currently under develop- 

35 ment will probably offer the required performance and 
cost efficiency. 

[0011] Advantageous embodiments of the invention 
are disclosed in the dependent claims, the following de- 
scription and the figure. 

40 

Brief description of the drawing 

[0012] Exemplary embodiments of the invention are 
described with reference to the accompanying drawing, 
45 which shows in Fig.1 a reproduction device for AV data 
stored on an optical disc, with a reconfigurable comput- 
ing unit that may receive its configuration data from the 
same optical disc. 

so Detailed description of the invention 

[0013] Reconfigurable architectures allow the imple- 
mentation of arbitrary logic functions, covering a wide 
range of cost, complexity and performance. Hence, the 
55 invention is based on the idea that these reconfigurable 
architectures may offer the required processing power 
for decoders according to recent and future multimedia 
coding schemes at a reasonable cost level, being 
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cheaper than high performance general purpose proc- 
essors or high performance DSPs. A reconfigurable ar- 
chitecture for multimedia decoding will include program- 
mable HW, but probably also dedicated HW as well as 
SW programmable units, like reduced instruction set 
computers (RISC) or other processors, e.g. array proc- 
essors. Hence, the implementation of a multimedia de- 
coder on a reconfigurable architecture may require two 
data streams: A configuration data stream for the recon- 
figurable HW, and a SW program. However, degrada- 
tions are possible to just HW configuration stream or just 
SW program. A further increase of efficiency is possible 
if the decode platform also allows dynamic reconfigura- 
tion during runtime. 

[0014] Fig.1 shows an example of such a multimedia 
decoder. AV data and configuration data are stored on 
an optical disc 1 , e.g. DVD, in different files or other stor- 
age units, e.g. packets. The data are read by a pick-up 
2, and sorted 3 according to their data type, which can 
be detected e.g. by the file name, packet header or data 
format. The read data types comprise AV presentation 
data 4, hardware configuration data 5 and software con- 
figuration data 6. The hardware configuration data 5 are 
used to configure a reconfigurable computing unit 8 
within a decoder chip 7. The software configuration data 

6 may contain parameters for programming the recon- 
figurable computing unit 8 or an embedded processor 
9, e.g. a RISC processor. The embedded processor 9 
may be used e.g. for standard tasks while the reconfig- 
urable computing unit 8 is used for implementation of a 
decoder which performs a specific decoding scheme, in 
order to decode the encoded AV data stream 4. The de- 
coded AV data 1 0 can be used for further processing, 
e.g. can be sent to a presentation unit, a rendering de- 
vice or the like. An advanced implementation of the chip 

7 containing theflexible decoder HW 8 may also perform 
rendering, or other tasks related to the further process- 
ing of AV data 4. 

[0015] According to the invention, both data streams, 
the hardware configuration data 5 and the software pro- 
gram 6, are stored on a storage device 1 together with 
the AV content data 4. 

[0016] If both data streams have standardized for- 
mats, the AV content can be coded in any format that 
allows real-time implementation of the respective de- 
coder on the provided reconfigurable hardware and the 
embedded processor. Minimum resources to be provid- 
ed by the reconfigurable device may be standardized as 
well. 

[0017] Advantageously, the proposed method for 
downloading HW/SW configuration data for a decoder 
is not limited to storage media. The general idea can be 
applied whenever hardware decoders are used for de- 
coding received encoded data, e.g. also for broadcast 
or satellite transmission. In this case HW and SW con- 
figuration data may be transmitted in certain intervals, 
or initially before transmission of AV data. 
[0018] In one embodiment of the invention, configu- 



ration dataforthe downloadable AV decoders are stored 
as preamble to content encoded with the respective en- 
coder. When a player reads the content, it may detect 
the configuration data, use them to configure hardware 
5 and software for the decoder and start decoding of the 
AV data. The time required for decoder configuration will 
probably not exceed few seconds, and may be used for 
other purposes, e.g. a menu may be displayed which 
requires no decoder. Typically the amount of configura- 
te? tion data 5,6 is much less than the amount of AV data 4. 
[0019] Another advantage of the current invention is 
that the specification layer for standardization of decod- 
ers may be changed. This allows employment of propri- 
etary coding technology. In contrast to just software pro- 
fs grammable architectures, reconfigurable hardware may 
provide better efficiency, higher flexibility, lower costs, 
reduced power consumption etc. 
[0020] In one embodiment of the invention the de- 
scribed method to provide decoder configuration data 
20 may be used for optional features representing addition- 
al services, thus enhancing a standard decoder or de- 
fining an additional decoder. E.g. a storage medium may 
contain conventionally coded standard AV data and ad- 
ditional data, comprising presentation data that are en- 
2s coded with a proprietary coder, and configuration data 
for the respective proprietary decoder, thus, only a play- 
er that contains a HW configurable decoder may access 
the additional data, and thus access an additional serv- 
ice. 

30 [0021] In another embodiment of the invention it is 
possible to reconfigure the hardware decoder during a 
presentation of AV data. This can be achieved by read- 
ing more AV data from the storage medium than current- 
ly needed, decoding them and buffering the decoded 

35 data during the presentation. While the decoded buff- 
ered data are presented, there is time for reading de- 
coder reconfiguration data and reconfiguring the decod- 
ers HW or SW. Then the other AV data requiring the 
reconfigured decoder can be read and decoded, and 

40 then buffered. If previously enough decoded data have 
been buffered, the presentation may continue seam- 
lessly. Thus It is possible to update a decoder at any 
time, or change the coding scheme within an encoded 
data stream, e.g. for adaptive coding for optimized data 

45 compression. Another possibility is that the SW decoder 
may take over decoding, probably with lower perform- 
ance, while the HW decoder is reconfigured. 
[0022] The inventive method can be used for decod- 
ing or processing any kind of data stored on a storage 

so medium, preferably a removable storage medium, when 
extensive computations must be performed with these 
data, and thus a HW-implemented decoder is superior 
to a pure software decoder. Moreover, the inventive 
method can also be used for decoding or processing da- 

55 ta received from any data source, e.g. broadcast. In this 
case, the broadcast transmitter may also send HW con- 
figuration data for a decoder. This may allow better ad- 
aptation of decoders to contents, or proprietary encryp- 
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tion of contents, being usable in particular for implemen- 
tation of pay-TV. Finally, the AV data and related decod- 
er configuration data may also be downloaded from an 
Internet domain. The inventive decoder may be utilized 
such that encoded AV presentation data and HW/SW 5 
configuration data required to decode the AV presenta- 
tion data are stored on the same Internet domain, and 
can be downloaded. This can be used for implementing 
a proprietary coding scheme, e.g. for optimized AV data 
compression. 

[0023] An exemplary application is a set top box suit- 
able to decode AV data received from a broadcast trans- 
mitter, e.g. terrestrial, or via cable or satellite, for display 
on a television set or similar. Among other things, such 
set top box may contain a reconfigurable device and a 
SW programmable device, e.g. an embedded RISC 
processor or DSP. To employ downloadable decoders, 
the broadcast station transmits e.g. three different data 
streams, namely a data stream for HW configuration, 
another data stream being an executable SW program, 
and the content data itself. If the decoder is implemented 
using either only reconfigurable HW or only software, 
the respective unused configuration data stream may 
be omitted. Anyway, using pure HW decoders is usually 
inefficient, and using pure SW decoders usually does 
not provide sufficient performance. Common broadcast 
schemes allow transmission of arbitrary additional data 
streams, without disturbing the critical real time content 
data streams, e.g. by time division multiplexing. This can 
be used for transmitting configuration data according to 
the invention. The configuration data streams will usu- 
ally be transmitted prior to the AV data stream. This 
transmission could be either directly before each con- 
tent transmission, or periodically in regular time inter- 
vals, e.g. once each hour or once a day. 
[0024] The set top box may identify each data stream 
e.g. by identification of individual header data transmit- 
ted in conjunction with each data stream. The HW con- 
figuration data stream is used for configuration of a 
reconfigurable device within the set top box. The SW 
program is then used to program one or more proces- 
sors, which may either be implemented on the integrat- 
ed circuit (IC) chip that contains the reconfigurable HW, 
or as a separate device. The configured HW in combi- 
nation with the SW def ines an AV decoder with real-time 
capability, which could after its configuration decode re- 
spective content data under real-time constraints. Such 
decoder can employ the advantages of a proprietary 
coding scheme, as mentioned above. The formats of the 
HW configuration data stream and/or the SW data 
stream are suitable subjects to standardization. 
[0025] Typical target applications are e.g. audio and/ 
or video data, preferably entertainment or informative 
data, which are stored on optical discs and may be de- 
coded using specialized hardware, e.g. due to content 
protection or high calculation effort. 



A method for decoding first data, the first data being 
read from a removable storage medium, using sec- 
ond data, the second data containing decoding in- 
formation for said first data, characterized in that 

the second data are read from the same remov- 
able storage medium; and 
- the decoding information contained in said sec- 
ond data comprises hardware configuration da- 
ta suitable for configuration of reconfigurable 
logic (8) within an integrated circuit chip (7). 

15 2. Method according to claim 1 , wherein said first data 
are audio or video data. 

3. Method according to any of the previous claims, 
wherein the second data also comprises software 

20 configuration data. 

4. Method according to any of the previous claims, 
wherein said decoding information contained in 
said second data improves the decoding of said first 

25 data. 

5. Method according to any of the previous claims, 
wherein the first data contain conventionally coded 
data and additional data, and wherein the second 

30 data comprise decoding information for the addi- 
tional data. 

6. Method according to any of the previous claims, 
wherein the first data comprise a first and a second 

35 portion and the second data comprise a first and a 
second portion, the first portion of the second data 
comprising first hardware configuration data for de- 
coding the first portion of the first data using recon- 
figurable logic (8), and the second portion of the 
40 second data comprising second hardware configu- 
ration data for decoding the second portion of the 
first data using the same reconfigurable logic (8), 
and wherein the reconfigurable logic (8) is reconfig- 
ured while said first portion of the first data 

45 

7. Method for decoding and presenting first data, the 
first data being read from a removable storage me- 
dium and comprising a first and a second portion, 
using second data, the second data containing 

so hardware configuration data being decoding infor- 
mation for said first data and comprising a first and 
a second portion, the method including the steps of 

retrieving from the medium the first portion of 
55 the second data; 

- configuring reconfigurable logic (8) within an in- 
tegrated circuit chip (7) using said first portion 
of the second data; 
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retrieving from the medium the first portion of 
the first data; 

decoding the first portion of the first data using 
said reconfigurable logic (8), buffering and pre- 
senting the decoded first portion of the first da- 5 
ta; 

retrieving from the medium the second portion 
of the second data; 

configuring the reconfigurable logic (8) using 
said second portion of the second data; 10 
retrieving from the medium the second portion 
of the first data; and 

. decoding the second portion of the first data us- 

ing said reconfigurable logic (8) and buffering 
the decoded second portion of the first data is 
while said decoded first portion of the first data 
is buffered and/or presented. 



8. Decoder for decoding first data, the first data being 
read from a removable storage medium , the decod- 20 
er comprising at least one integrated circuit chip (7), 
characterized In that 

the integrated circuit chip (7) incorporates 
reconfigurable logic (8); 

the decoder Is specified by second data, the 
second data comprising configuration data for 
said reconfigurable logic (8); and 
said first and said second data are read from 
the same removable storage medium. 

9. Decoder according to the preceding claim, wherein 
the removable storage medium is an optical disc. 

10. Decoder according to claim 8 or 9, wherein said first 35 
data comprise audio or video data. 

11. Decoder according to any of claims 8-10, wherein 
the first data contain conventionally coded data and 
additional data, and wherein the second data com- *o 
prise decoding information for the additional data. 

12. Removable storage medium storing first and sec- 
ond data, the first data being encoded audio and/or 
video data, characterized in that 45 

the second data contain decoding information 
for the first data; and 
- the second data comprise hardware configura- 
tion data suitable for configuration of reconfig- so 
urable logic (8) within an integrated circuit chip 

in 
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